Accessory device that provides sensor input to a media device

ABSTRACT

A method includes receiving information at a media device from an accessory device. The information includes first image data captured by a camera and second image data captured by the camera subsequent to capture of the first image data. The camera is a component of an earpiece of the accessory device. The method includes identifying, at a processor of the media device, a particular limb movement of a user of the accessory device based on the information. The method also includes performing an action with the processor, the action based on the particular limb movement.

PRIORITY CLAIM

This application is a continuation of, and claims priority to, U.S.patent application Ser. No. 14/527,513, filed Oct. 29, 2014, which ishereby incorporated by reference in its entirety.

FIELD OF THE DISCLOSURE

The present disclosure is generally related to accessory devices thatprovide sensor input to a media device.

BACKGROUND

An accessory device, such as headphones, may be connected to a mediadevice (e.g., a smartphone) via a wired audio interface (e.g., a miniphono jack), but the accessory device may provide limited information orno information to the media device for use by the media device inperforming one or more functions.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram of a particular embodiment of a system fordetermining, based on information associated with a movement of anaccessory device (that is communicatively coupled to a media device viaa wired interface) whether the accessory device satisfies accessorydevice orientation criteria;

FIG. 2 is a diagram of a particular embodiment of a system foridentifying head movements of a user based on image data captured bycamera(s) associated with an accessory device (e.g., an audio headsetdevice);

FIG. 3 is a diagram of a particular embodiment of a system foridentifying hand movements of a user based on image data captured bycamera(s) associated with an accessory device (e.g., an audio headsetdevice);

FIG. 4 is a diagram of a particular embodiment of a system foridentifying leg movements of a user based on image data captured bycamera(s) associated with an accessory device (e.g., an audio headsetdevice);

FIG. 5 is a flowchart that illustrates a particular embodiment of amethod to determine, based on information associated with a movement ofan accessory device (that is communicatively coupled to a media devicevia a wired interface) whether the accessory device satisfies accessorydevice orientation criteria;

FIG. 6 is a flowchart that illustrates a particular embodiment of amethod to identify a movement (e.g., a head movement, a hand movement,or a leg movement) based on image data captured by a camera disposedwithin an earpiece of an audio headset device and sending an audiosignal to the audio headset device based on the identified movement;

FIG. 7 is a flowchart that illustrates a particular embodiment of amethod to identify a movement (e.g., a head movement) based on imagedata captured by cameras disposed within earpieces of an audio headsetdevice and sending an audio signal to the audio headset device based onthe identified movement; and

FIG. 8 is a block diagram of an illustrative embodiment of a generalcomputer system.

DETAILED DESCRIPTION

An accessory device (e.g., a wearable audio output device) may include asensor in order to provide sensed data to a media device (e.g., asmartphone). In some cases, the sensor may be a media sensor (e.g., acamera) or a non-media sensor (e.g., a sensor other than an audio sensoror a video sensor). Examples of non-media sensors include anaccelerometer, a compass, or a gyroscope, which may sense movement ofthe accessory device and provide information associated with themovement to the media device via an audio interface (e.g., a wired audiointerface, such as a mini phono jack, or a wireless audio interface).For example, an audio headset device (e.g., headphones or ear buds) mayinclude camera(s) in one or both earpieces, and the camera(s) may beused to determine user movement data (e.g., head movements, handmovements, or leg movements) and communicate the user movement data tothe media device. Alternatively or additionally, the audio headsetdevice may include an accelerometer to provide user movement data (e.g.,head movements up, down, left, or right) and communicate the usermovement data to the media device and/or a compass to provide userdirection data (e.g., east, west, north or south) to the media device.

In some cases, information associated with movement of the accessorydevice may be useful while the media device is providing directions tothe user. The media device may use the movement information (e.g., headmovement(s), hand movement(s), leg movement(s), or a combinationthereof) received from the sensor(s) of the accessory device in order todetermine whether the accessory device satisfies particular orientationcriteria (e.g., whether the user's head is correctly positioned forreceiving directions to a particular location). When the accessorydevice does not satisfy the orientation criteria (e.g., when the user isfacing the wrong direction), the media device may generate an audiosignal for communication to a user of the accessory device via the wiredaudio interface.

In some cases, the audio signal may include accessory devicere-orientation information that may identify a head movement to effect are-orientation of the audio headset device so that the orientationcriteria are satisfied. For example, when a navigation application isoperating at the media device and has determined navigation directionsto a particular location, the audio signal may include updatednavigation directions with instructions to look right or to look left sothat the user's head is correctly positioned for receiving directions tothe particular location. To illustrate, if a user is looking for acoffee shop that is located in a direction to her left, when the userlooks right, the media device may provide a message, such as “No, notthat direction. Look the other way.” By contrast, when the accessorydevice satisfies the orientation criteria, the media device may generatea second audio signal confirming that the user's head is correctlypositioned. To illustrate, when the user looks left (the correctdirection), the media device may provide another message, such as “Yes,right down that street you should see it on the left side of the roadabout 300 yards away.” In the context of navigation directions, themedia device may provide the updated navigation directions responsive tohead movement(s), hand movement(s), leg movement(s), or a combinationthereof. Thus, the present disclosure describes various illustrativeexamples of an accessory device that may provide sensed data to a mediadevice, and the media device may perform one or more operations based atleast in part on the sensed data.

In a particular embodiment, a method includes receiving information at amedia device that is associated with movement of an accessory device.The accessory device is communicatively coupled to the media device viaa wired interface of the media device (e.g., a cord and/or a mini-phonejack of the media device) or via a wireless interface of the mediadevice. The method includes determining, at the media device, whetherthe accessory device satisfies accessory device orientation criteriabased on the information. In response to determining that the accessorydevice does not satisfy the accessory device orientation criteria, themethod includes generating a signal (e.g., an audio signal). The audiosignal may be communicated from the media device to the accessory devicevia the wired interface. In some cases, the audio signal may includeaccessory device re-orientation information. In other cases, a videosignal may be generated and displayed at the media device. For example,in the context of providing navigation directions to a particularlocation, a warning indicator (e.g., a flashing red sign) may bedisplayed in order to alert a user (e.g., a deaf user) that the user ismoving in a wrong direction with respect to the particular location.

In another particular embodiment, a computer-readable storage devicestores instructions that, when executed by a processor, cause theprocessor to perform operations. The operations include receiving firstimage data captured (at a first time) by a first camera disposed withina first earpiece of an audio headset device and receiving second imagedata captured (at a second time) by the first camera disposed within thefirst earpiece. The operations further include identifying a movement(e.g., a head movement, a hand movement, a leg movement, or acombination thereof) based on the first image data and the second imagedata and sending an audio signal to the audio headset device that isdetermined based on the identified movement.

In another particular embodiment, an apparatus includes a processor anda memory. The memory is accessible to the processor and includesinstructions executable by the processor to perform operations. Theoperations include receiving first and second image data captured by afirst camera disposed within a first earpiece of an audio headsetdevice. The operations further include receiving third and fourth imagedata captured by a second camera disposed within a second earpiece ofthe audio headset device. The operations include generating a firstcomposite image (e.g., a stereoscopic image) based on the first imagedata captured by the first camera and the third image data captured bythe second camera. The operations further include generating a secondcomposite image (e.g., a second stereoscopic image) based on the secondimage data captured by the first camera and the fourth image datacaptured by the second camera. The operations also include identifying amovement (e.g., a head movement, a hand movement, a leg movement, or acombination thereof) based on the first composite image and the secondcomposite image. The operations include determining whether the movementsatisfies directional orientation criteria (e.g., for receivingnavigation directions to a particular location) and sending an audiosignal to the audio headset device that identifies whether the movementsatisfies the directional orientation criteria.

FIG. 1 illustrates a particular embodiment of a system 100 fordetermining, based on information associated with a movement of anaccessory device that is communicatively coupled to a media device(e.g., via a wired or a wireless interface), whether the accessorydevice satisfies accessory device orientation criteria. In the exampleof FIG. 1, the accessory device includes an audio headset device (e.g.,headphones or earbuds), and a user 102 is shown wearing the audioheadset device. The audio headset device may be communicatively coupledto an audio input (e.g., a mini-phono jack) of a media device 104 (e.g.,a smartphone or other mobile computing device) via an audio interface106. When the audio headset device is communicatively coupled to themedia device 104, signals may be communicated via one or more wires 108between the media device 104 and a first earpiece 110 of the audioheadset device and between the media device 104 and a second earpiece112 of the audio headset device. While FIG. 1 illustrates a user's head,it will be appreciated that the information associated with movement ofthe accessory device (e.g., an audio headset device) may include headmovement(s), hand movement(s), leg movement(s), or a combinationthereof, as further described herein with respect to FIGS. 2-4.

In the particular embodiment illustrated in FIG. 1, the first earpiece110 includes a speaker 114 and one or more sensors. In FIG. 1, thesensor(s) disposed within the first earpiece 110 include a first sensor116 (e.g., a camera), a second sensor 118 (e.g., an accelerometer), anda third sensor 120 (e.g., a compass). In alternative embodiments, thefirst earpiece 110 may include more than three sensors or less thanthree sensors. FIG. 1 further illustrates that the second earpiece 112includes a speaker 122 and one or more sensors. In FIG. 1, the sensorsdisposed within the second earpiece 112 include a first sensor 124(e.g., a camera), a second sensor 126 (e.g., an accelerometer), and athird sensor 128 (e.g., a compass). In alternative embodiments, thesecond earpiece 112 may include more than three sensors or less thanthree sensors. An alternative or an additional example of sensors mayinclude a sensor to receive local broadcast information, such asweather, traffic, or emergency conditions (that may alert a user tochange a direction). Further, in some embodiments, the first earpiece110 may include the speaker 114 and sensor(s), while the second earpiece112 may include the speaker 122 but no sensors. In other embodiments,the second earpiece 112 may include the speaker 122 and sensor(s), whilethe first earpiece 110 may include the speaker 114 but no sensors.

In the particular embodiment illustrated in FIG. 1, the media device 104includes an image module 130, a navigation module 132, an audioadjustment module 134, and a workout module 136. In some cases, theworkout module 136 may correspond to a module for use in an indoorworkout context (e.g., for hand/leg movements at a gym). That is, theworkout module 136 may be used to capture and store information withrespect to hand/leg movements in an indoor workout context (e.g., foruse in providing guidance to a user with respect to particular workoutmovements). As another example, the workout module 136 may correspond toa module for use in an outdoor workout context (e.g., for leg movementssuch as jogging or cycling). That is, the workout module 136 may be usedto capture and store information with respect to leg movements andassociated music tracks that were played depending on a pace of legmovements (e.g., songs played when running, songs played when jogging,or songs played when walking, among other alternatives). The previouslyplayed music tracks may be replayed when leg movements are detected thatcorrespond to a particular pace of movement. In alternative embodiments,the media device 104 may include more than four modules or less thanfour modules. In the example of FIG. 1, sensor data 138 may becommunicated to the media device 104 from one or more of the sensors114-120 disposed within the first earpiece 110, and sensor data 140 maybe communicated to the media device 104 from one or more of the sensors122-128 disposed within the second earpiece 112. FIG. 1 illustrates aparticular example in which the sensor data 138 from the first earpiece110 may include image data, and the sensor data 140 from the secondearpiece 112 may include image data. As an example, the first sensor 116disposed within the first earpiece 110 may be a camera that may captureimage data and provide the image data to the media device 104 as thesensor data 138, and the first sensor 124 disposed within the secondearpiece 112 may be a camera that may capture image data and provide theimage data to the media device 104 as the sensor data 140.

FIG. 1 further illustrates that the media device 104 may output an audiosignal 142 (e.g., a mono audio signal or a stereo audio signal) that maybe communicated to the first earpiece 110, to the second earpiece 112,or a combination thereof. In the example illustrated in FIG. 1, from theperspective of the user 102, the first earpiece 110 is positioned in theuser's right ear, while the second earpiece 112 is positioned in theuser's left ear. The first earpiece 110 may correspond to a “right”earpiece of the audio headset device, and the second earpiece 112 maycorrespond to a “left” earpiece. Thus, in the case of a stereo signal,the audio signal 142 may include a first audio signal that is directedto the first earpiece 110 (e.g., a right-ear signal) and a second audiosignal that is directed to the second earpiece 112 (e.g., a left-earsignal). Further, in the example of FIG. 1, the sensor data 138 capturedby sensor(s) disposed within the first earpiece 110 (e.g., image datacaptured by the first sensor 116) may correspond to information (e.g.,an image) representing a right-hand direction from the perspective ofthe user 102. The sensor data 140 captured by sensor(s) disposed withinthe second earpiece 112 (e.g., image data captured by the first sensor124) may correspond to information (e.g., an image) representing aleft-hand direction from the perspective of the user 102.

In some embodiments, the image module 130 of the media device 104 may beconfigured to determine whether the first earpiece 110 satisfiesaccessory device orientation criteria based on the sensor data 138(e.g., first image data) received from the first earpiece 110. Asanother example, the image module 130 may be configured to determinewhether the second earpiece 112 satisfies accessory device orientationcriteria based on the sensor data 140 (e.g., second image data) receivedfrom the second earpiece 112. In a particular embodiment, the imagemodule 130 may be configured to generate a composite image (e.g., athree-dimensional (3D) or stereoscopic image) based on the first imagedata received from the first earpiece 110 and the second image datareceived from the second earpiece 112. In this case, from theperspective of the user 102, the composite image may correspond to apanoramic view that includes image data captured by one camera (e.g.,the first sensor 116) positioned in a right-hand direction and anothercamera (e.g., the first sensor 124) positioned in a left-hand direction.Thus, in the example of FIG. 1, the image module 130 of the media device104 may be configured to determine, from the perspective of the user102, a position of a user's head. As an illustrative, non-limitingexample, the composite image may be used to detect obstacles that mayblock a user's path (e.g., traffic, a road closure, etc.) and alert theuser in advance.

In some embodiments, the navigation module 132 may be operating at themedia device 104 and may have determined navigation directions to aparticular location (e.g., responsive to a request received from theuser 102 for directions to the particular location). In some cases, theuser 102 may request directions by speaking the request or providinglocation information via an input device of the media device 104 (e.g.,a touchscreen), among other alternatives. In this illustrative example,the navigation module 132 may provide initial navigation directions tothe particular location, and the audio signal 142 generated by the mediadevice 104 may include updated navigation directions based on a positionof the user's head (or hand or leg or a combination thereof) withrespect to the particular location. To illustrate, the image module 130may be configured to provide information to the navigation module 132with respect to a position of the user's head (e.g., for the navigationmodule 132 to determine whether navigation directions that werepreviously provided to the user 102 with respect to the particularlocation are correct in light of the position of the user's head). InFIG. 1, the first earpiece 110 is positioned in the user's right earfrom the perspective of the user 102, while the second earpiece 112 ispositioned in the user's left ear from the perspective of the user 102.Thus, the information communicated from the image module 130 to thenavigation module 132 may identify the sensor data 138 from the firstearpiece 110 as corresponding to information from a right-handperspective of the user 102 and may identify the sensor data 140 fromthe second earpiece 112 as corresponding to information from a left-handperspective of the user 102. Based on the information, the navigationmodule 132 may be configured to generate the audio signal 142. In theevent that the information indicates that the user's head is notcorrectly positioned for receiving navigation directions to a particularlocation, the audio signal 142 may include updated navigation directions(or updated road conditions or a traffic congestion report, among otheralternatives).

As an illustrative, non-limiting example, the sensor data 138 from thefirst earpiece 110 may correspond to first image data, and the sensordata 140 from the second earpiece 112 may correspond to second imagedata. As described further herein with respect to FIG. 2, the mediadevice 104 may process the image data received from one or more of theearpieces 110, 112 in order to determine head movement(s) of the user102. The navigation module 132 may update navigation directions to aparticular location based on the head movement(s) of the user 102 whenthe head movement(s) indicates that the user's head is not correctlypositioned for receiving navigation directions to the particularlocation. Thus, in this example, the sensor data 138, 140 representsimage data that is provided to the media device 104 and that may be usedas input data to one or more modules (e.g., the image module 130 and thenavigation module 132) of the media device 104.

As a further example, the sensor data 138 from the first earpiece 110and/or the sensor data 140 from the second earpiece 112 may includeaccelerometer data measured by the second sensor 118 and/or the secondsensor 126. As another illustrative example, the sensor data 138 fromthe first earpiece 110 and/or the sensor data 140 from the secondearpiece 112 may include compass data from the third sensor 120 and/orthe third sensor 128. In this case, the media device 104 may beconfigured to determine head movement(s) based on the accelerometer dataand/or the compass data and may provide the information to the audioadjustment module 134 and/or to the workout module 136. To illustrate,as part of an audio application (e.g., a music player application), theaudio adjustment module 134 may increase a volume of the audio signal142 in response to an upward head movement and may decrease the volumein response to a downward head movement. As another example, a directionand/or a speed of a detected head movement may be determined based onthe accelerometer data and/or the compass data and may be used to skipforward through audio tracks, to skip backward through audio tracks, tofast forward through audio tracks, and/or to fast forward backwardthrough audio tracks, among other alternatives.

Thus, FIG. 1 illustrates that one or more sensors included in anaccessory device (e.g., an audio headset device) may be used to providesensor data to a media device. In some cases, the sensor data may beused to determine whether the accessory device satisfies accessorydevice orientation criteria. To illustrate, the media device 104 maygenerate a first audio signal in response to determining that theaccessory device orientation criteria are not satisfied and may generatea second audio signal in response to determining that the accessorydevice orientation criteria are satisfied. To illustrate, the firstaudio signal may include accessory device re-orientation information(e.g., for receiving navigation directions to a particular location),while the second audio signal may include a confirmation of correctpositioning (e.g., for receiving the navigation directions). In othercases, the sensor data may be provided to an audio application to beused to adjust a volume of an audio signal or to navigate betweentracks, or the sensor data may be provided to a gaming application toperform particular player movements or other game play operations, amongother alternatives.

FIG. 2 illustrates a particular embodiment of a system 200 foridentifying one or more head movements 202 of the user 102 based onimage data captured by one or more cameras associated with an accessorydevice (e.g., an audio headset device) that is communicatively coupledto the media device 104 (e.g., via a wired interface). FIG. 2illustrates one particular example in which image data is used todetermine the head movement(s) 202. However, as described further hereinwith respect to FIGS. 3 and 4, the image data may be used to determinehand movement(s), leg movement(s), or any combination of head, hand, orleg movement(s). FIG. 2 illustrates that the media device 104 maygenerate an audio signal based on the identified head movement(s) 202.In a particular embodiment, in the context of navigation directions, thehead movement(s) 202 may be used to determine whether a user's head isproperly oriented for receiving navigation directions to a particularlocation. In the event that the user's head is not properly positioned,the media device 104 may provide updated navigation directions to theparticular location.

In the example illustrated in FIG. 2, the camera 116 disposed within thefirst earpiece 110 is configured to capture a first image 204 (at afirst time) and to provide information associated with the first image204 to the media device 104 as first image data 206. The camera 116disposed within the first earpiece 110 is further configured to capturea second image 208 (at a second time) and to provide informationassociated with the second image 208 to the media device 104 as secondimage data 210. The camera 124 disposed within the second earpiece 112is configured to capture a first image 212 and to provide informationassociated with the first image 212 to the media device 104 as firstimage data 214. The camera 124 of the second earpiece 112 is furtherconfigured to capture a second image 216 and to provide informationassociated with the second image 216 to the media device 104 as secondimage data 218.

In some cases, the media device 104 may generate a first composite image(e.g., a stereoscopic image) based on the first image 204 captured bythe camera 116 disposed within the first earpiece 110 and based on thefirst image 212 captured by the camera 124 disposed within the secondearpiece 112. Further, in some cases, the media device 104 may generatea second composite image (e.g., a second stereoscopic image) based onthe second image 208 captured by the camera 116 disposed within thefirst earpiece 110 and based on the second image 216 captured by thecamera 124 disposed within the second earpiece 112. In a particularembodiment, the media device 104 may identify the head movement(s) 202by comparing the first composite image to the second composite image.

In the illustrative, non-limiting example of FIG. 2, the headmovement(s) 202 may include a movement of the user's head to the right(from the perspective of the user 102). In this case, the camera 116disposed within the first earpiece 110 may capture the first image 204at a first time and communicate the information associated with thefirst image 204 to the media device 104 as the first image data 206.Further, in some cases, the camera 124 disposed within the secondearpiece 112 may capture the first image 212 at substantially the sametime and provide the information associated with the first image 212 tothe media device 104 as the first image data 214 (e.g., at substantiallythe same time as the first image data 206). While FIG. 2 illustrates oneexample in which the head movement(s) 202 include a movement of theuser's head to the right, in alternative embodiments, the headmovement(s) 202 may include a movement of the user's head to the right,to the left, in an upward direction, in a downward direction, or acombination thereof (from the perspective of the user 102). The imagemodule 130 of the media device 104 may identify a movement of the user'shead by comparing the first image data 206 from the first earpiece 110,the second image data 210 from the first earpiece 110, the first imagedata 214 from the second earpiece 112, the second image data 218 fromthe second earpiece 212, or any combination thereof. Based on theidentified movement, the media device 104 is configured to generate anaudio signal 220 and communicate the audio signal 220 to one or more ofthe earpieces 110, 112.

FIG. 2 illustrates a particular embodiment in which the image module 130of the media device 104 may determine a movement (e.g., of the user'shead) based on one or more reference objects (e.g., trees, stationaryautomobiles, buildings, other stationary objects, etc.) in one or moreof the images. FIG. 2 illustrates a simplified example in which thefirst image 204 captured by the camera 116 disposed within the firstearpiece 110 includes a first reference object 222 and a secondreference object 224, while the second image 208 captured by the camera116 includes the second reference object 224 and a third object 226. Inone embodiment, the image module 130 may identify the head movement(s)202 as a movement to the right (from the perspective of the user 102)based on the absence of the first reference object 222 from the secondimage 208. As another example, the image module 130 may identify adirection of the head movement(s) 202 based on movement of the secondreference object 224 from a first location in the first image 204 (e.g.,first X, Y, and/or Z coordinates) with respect to a second location inthe second image 206 (e.g., second X, Y, and/or Z coordinates). As afurther example, the image module 130 may identify a direction of thehead movement(s) 202 based on the absence of the third object 226 in thefirst image 204 and the presence of the third object 226 in the secondimage 208. In alternative embodiments, alternative numbers of referenceobjects may appear in one or more of the images captured by the camera116 disposed within the first earpiece 110.

In the example illustrated in FIG. 2, the first image 212 captured bythe camera 124 disposed within the second earpiece 112 includes a firstreference object 228 and a second reference object 230, while the secondimage 216 captured by the camera 124 includes the second referenceobject 230 and a third object 232. In one embodiment, the image module130 may identify the head movement(s) 202 as a movement to the right(from the perspective of the user 102) based on the absence of the firstreference object 228 from the second image 216. As another example, theimage module 130 may identify a direction of the head movement(s) 202based on movement of the second reference object 230 from a firstlocation in the first image 212 (e.g., first X, Y, and/or Z coordinates)with respect to a second location in the second image 216 (e.g., secondX, Y, and/or Z coordinates). As a further example, the image module 130may identify a direction of the head movement(s) 202 based on theabsence of the third object 232 in the first image 212 and the presenceof the third object 232 in the second image 216. In alternativeembodiments, alternative numbers of reference objects may appear in oneor more of the images captured by the camera 124 disposed within thesecond earpiece 112.

In some cases, the navigation module 132 may be configured to determinewhether to provide updated navigation directions to the user 102 (e.g.,via the audio signal 220 or via a visual indication on a display of themedia device 104). As an illustrative, non-limiting example, thenavigation module 132 may be executing at the media device 104 and mayprovide navigation directions to a coffee shop that may be located on aleft side of a street (from the perspective of the user 102). In thiscase, when the image module identifies that the head movement(s) 202indicate that the user 102 is looking right (rather than left), themedia device 104 may generate the audio signal 220 with updatednavigation directions, such as “No, not that direction, look the otherway.” By contrast, in some embodiments, if the head movement(s) 202indicates that the user is looking left (from the perspective of theuser 102), the media device 104 may generate the audio signal 220 toprovide confirmation that the user's head is correctly positioned forreceiving the navigation directions. To illustrate, the media device 104may generate an audio signal, such as “Yes, right down that street, youshould see it on the left side of the road about 300 yards away.”

Thus, FIG. 2 illustrates a particular example in which camera(s)associated with earpiece(s) of an audio headset device may provide imagedata to the media device 104 that may be used to determine headmovement(s) based on the presence or absence of reference object(s) inimages captured by the camera(s). In some cases, the head movement(s)may be used to provide updated navigation directions when the image datacaptured by the camera(s) indicates that a user's head is incorrectlypositioned to receive navigation directions to a particular location. Inthis case, the media device may generate updated navigation directionsthat may prompt the user to move her head to a different orientation.Alternatively, the head movement(s) may be used to confirm that theuser's head is properly positioned to receive navigation directions to aparticular location, and in some cases the media device may generate aconfirmation message to notify the user that her head is correctlypositioned to receive the navigation directions. In other cases, theimage data may be provided to an audio application to be used to adjusta volume of an audio signal or to navigate between tracks, or the imagedata may be provided to a gaming application to perform particularplayer movements or other game play operations, among otheralternatives.

FIG. 3 illustrates a particular embodiment of a system 300 foridentifying hand movement(s) 302 based on image data captured by one ormore cameras associated with an accessory device (e.g., an audio headsetdevice) that is communicatively coupled to the media device 104 (e.g.,via a wired interface). FIG. 3 illustrates that hand movement(s) 304 ofthe user 102 may also be identified based on information received fromanother device (e.g., a wearable device 306). FIG. 3 illustrates oneparticular example in which image data and/or sensor data from thewearable device 306 is used to determine the hand movement(s) 302 and/orthe hand movement(s) 304. However, as described further herein withrespect to FIGS. 2 and 4, the image data and/or sensor data from thewearable device 306 may be used to determine head movement(s), legmovement(s), or any combination of head, hand, or leg movement(s).

In the particular embodiment illustrated in FIG. 3, the camera 116disposed within the second earpiece 112 is configured to identify thehand movement(s) 302 associated with a first hand 308 of the user 102(e.g., a left hand from the perspective of the user 102). In FIG. 3, thewearable device 306 includes one or more sensors to identify the handmovement(s) 304 associated with a second hand 310 of the user 102 (e.g.,a right hand from the perspective of the user 102). However, it will beappreciated that the example of FIG. 3 is for illustrative purposes andthat in alternative embodiments, the camera 124 disposed within thefirst earpiece 110 may be used to identify the hand movement(s) 304associated with the second hand 310. Further, the wearable device 306may be associated with the first hand 308 rather than the second hand310 and may be used to track the hand movement(s) 302 of the first hand308.

In the example of FIG. 3, the camera 124 disposed within the secondearpiece 112 is configured to capture a first image 312 and to provideinformation associated with the first image 312 to the media device 104(e.g., as first image data). The camera 124 disposed within the secondearpiece 112 is further configured to capture a second image 314 and toprovide information associated with the second image 314 to the mediadevice 104 (e.g., as second image data). FIG. 3 illustrates a particularexample in which the hand movement(s) 302 associated with the first hand308 represent a movement in a right-hand direction from the perspectiveof the user 102. In some cases, the first hand 308 may be used as areference object to determine the hand movement(s) 302. For example, theimage module 130 of the media device 104 may identify a direction of thehand movement(s) 302 based on movement of the first hand 308 from afirst location in the first image 312 (e.g., first X, Y, and/or Zcoordinates) with respect to a second location in the second image 314(e.g., second X, Y, and/or Z coordinates).

In some cases, the navigation module 132 of the media device 104 may beconfigured to determine whether to provide updated navigation directionsbased on the identified hand movement(s) 302. As an illustrative,non-limiting example, the media device 104 may provide navigationdirections to a gas station that may be located on a right side of astreet (from the perspective of the user 102). To illustrate, in theexample of FIG. 3, the image module 130 may identify that the handmovement(s) 302 indicate that the user 102 is pointing right (ratherthan left) in response to receiving navigation directions to the gasstation. Accordingly, in some embodiments, the media device 104 maygenerate an audio signal to provide confirmation that the user's hand ispointing to a correct side of the street. To illustrate, the mediadevice 104 may generate an audio signal, such as “Yes, the gas stationis on the right side of the road about 200 yards away.” By contrast, insome embodiments, if the hand movement(s) 302 indicates that the user102 is pointing left (from the perspective of the user 102) in responseto receiving navigation directions to the gas station, the media device104 may generate an audio signal with updated navigation directions. Toillustrate, the media device 104 may generate an audio signal, such as“No, not on that side of the street, the gas station is located on theother side of the street.”

FIG. 3 illustrates a particular embodiment in which the wearable device306 includes a first sensor 316 (e.g., an accelerometer) and a secondsensor 318 (e.g., a compass). However, it will be appreciated that inalternative embodiments more than two sensors or less than two sensorsmay be used. In some cases, the wearable device 306 may communicatesensor data to the media device 104 via a wireless signal (e.g., a Wi-Fisignal or a near-field communication signal). The media device 104 maybe configured to determine the hand movement(s) 304 based onaccelerometer data received from the first sensor 316 of the wearabledevice 306 and/or compass data received from the second sensor 318 ofthe wearable device 306. In some cases, the media device 104 may provideinformation associated with the hand movement(s) 304 to the navigationmodule 132, the audio adjustment module 134, and/or the workout module136. With respect to navigation, the navigation module 132 may provideupdated navigation directions and/or a confirmation of a particulardirection based on the hand movement(s) 304 in a manner similar to thatdescribed above with respect to the hand movement(s) 302.

As another example, the audio adjustment module 134 may increase avolume of the audio signal 142 in response to an upward hand movementand may decrease the volume in response to a downward hand movement. Asother examples, a direction and/or a speed of a detected hand movementmay be used to skip forward through audio tracks, to skip backwardthrough audio tracks, to fast forward through audio tracks, to fastforward backward through audio tracks, among other alternatives. Toillustrate, a one-time short-distance quick hand movement to the rightmay correspond to skipping forward through audio tracks, while aone-time short-distance quick hand movement to the left may correspondto skipping backward through audio tracks. As another example, atwo-time long-distance quick hand movement to the right may correspondto fast forwarding through audio tracks, while a two-time long-distancequick hand movement to the left may correspond to fast forwardingbackward through audio tracks. As a further example, a one-timelong-distance hand movement to the right or to the left may correspondto stopping or pausing a search through audio tracks. An up or down handmovement may correspond to playing or accepting an option (e.g., asong), while a left or right hand movement may correspond to cancellingan option. In an example, head/hand/foot movements for gesture controlmay be distinguished from normal movements duringwalking/jogging/running by virtue of being sudden or unexpected insteadof rhythmic or expected. Alternatively, a user may say a specificphrase, make a specific movement, or otherwise indicate that movementthat follows is a gesture control input. In a particular embodiment, thehand movement(s) 302 may be used as input data to a gaming application.As an illustrative, non-limiting example, a particular hand movement maycorrespond to a particular action in a game. For example, when the handmovement(s) 302 includes upward hand movement(s), a first action (e.g.,a punch in a combat game or reloading a weapon in a first-person shootergame) may be executed. As another example, when the hand movement(s) 302includes left or right movement(s), other actions (e.g., scrolling leftor right in a menu of selectable options) may be executed. As a furtherexample, when the hand movement(s) 302 include downward handmovement(s), another action (e.g., selecting one of the selectableoption from the menu of selectable options) may be executed. As anotherexample, when the gaming application includes music (e.g., a guitarplaying game or a dancing game), the hand movement(s) 302 may be used todetermine whether body movement(s) are synchronized with the music. Toillustrate, a user's score in the game may increase in response todetecting movement such as a quick twist when a music volume increasesor the music is relatively fast-paced (e.g., rock music). As anotherexample, the user's score may increase in response to detecting movementsuch as slow motion when the music is relatively slow-paced.

In some cases, the wearable device 306 may be used to provide command(s)to the media device 104 when it may be inconvenient for the user 102 toprovide input via the media device 104 itself (e.g., when the user iswalking, jogging, or running). Accordingly, the accelerometer dataand/or the compass data from the wearable device 306 may provide analternative option for providing command(s) to the media device 104. Asillustrative examples, a very quick hand movement may be used to accessa rock/rap/fast-paced song list, a quick hand movement may be used toaccess a light rock song list, a slow hand movement may be used toaccess a light rock song list, and a very slow hand movement may be usedto access a classical/slow-paced song list.

Thus, FIG. 3 illustrates a particular example in which camera(s)associated with earpiece(s) of an audio headset device may be used todetermine hand movement(s). In some cases, the hand movement(s) may beused to provide updated navigation directions when the image datacaptured by the camera(s) indicates that a user's hand is pointing in awrong direction with respect to a particular location. In this case, themedia device may generate an audio signal that may indicate that theuser is pointing in the wrong direction. Alternatively, the handmovement(s) may be used to confirm that the user's hand is pointing in acorrect direction with respect to a particular location. FIG. 3 furtherillustrates that, in some cases, a wearable device may include sensor(s)that may be used to provide information to a media device that may beused to identify hand movement(s).

FIG. 4 illustrates a particular embodiment of a system 400 foridentifying leg movement(s) 402 based on image data captured by one ormore cameras associated with an accessory device (e.g., an audio headsetdevice) that is communicatively coupled to the media device 104 (e.g.,via a wired interface). FIG. 4 illustrates that leg movement(s) 404 mayalso be identified based on information received from another device(e.g., a wearable device 406). FIG. 4 illustrates one particular examplein which image data and/or sensor data from the wearable device 406 isused to determine the leg movement(s) 402 and/or the leg movement(s)404. However, as described further herein with respect to FIGS. 2 and 3,the image data and/or sensor data from the wearable device 406 may beused to determine head movement(s), hand movement(s), or any combinationof head, hand, or leg movement(s).

In the particular embodiment illustrated in FIG. 4, the camera 116disposed within the second earpiece 112 is configured to identify theleg movement(s) 402 associated with a first leg 408 of the user 102(e.g., a left leg from the perspective of the user 102). In FIG. 4, thewearable device 406 includes one or more sensors to identify the legmovement(s) 404 associated with a second leg 410 of the user 102 (e.g.,a right leg from the perspective of the user 102). However, it will beappreciated that the example of FIG. 4 is for illustrative purposes onlyand that in alternative embodiments, the camera 124 disposed within thefirst earpiece 110 may be used to identify the leg movement(s) 404associated with the second leg 410. Further, the wearable device 406 maybe associated with the first leg 408 rather than the second leg 410 andmay be used to track the leg movement(s) 402 of the first leg 408.Alternatively, another wearable device (not shown) may be associatedwith the first leg 408, and the other wearable device may be used totrack the leg movement(s) 402 of the first leg 408, and the wearabledevice 406 may be used to track the leg movement(s) 404 of the secondleg 410.

In the example of FIG. 4, the camera 124 disposed within the secondearpiece 112 is configured to capture a first image 412 and to provideinformation associated with the first image 412 to the media device 104(e.g., as first image data). The camera 124 disposed within the secondearpiece 112 is further configured to capture a second image 414 and toprovide information associated with the second image 414 to the mediadevice 104 (e.g., as second image data). FIG. 4 illustrates a particularexample in which the leg movement(s) 402 associated with the first leg408 represent a movement in a right-hand direction from the perspectiveof the user 102. In some cases, the leg 408 may be used as a referenceobject to determine the leg movement(s) 402. For example, the imagemodule 130 of the media device 104 may identify a direction of the legmovement(s) 402 based on movement of the first leg 408 from a firstlocation in the first image 412 (e.g., first X, Y, and/or Z coordinates)with respect to a second location in the second image 414 (e.g., secondX, Y, and/or Z coordinates).

In some cases, the navigation module 132 of the media device 104 may beconfigured to determine whether to provide updated navigation directionsbased on the identified leg movement(s) 402. As an illustrative,non-limiting example, the media device 104 may provide navigationdirections to a gas station that may be located on a right side of astreet (from the perspective of the user 102). To illustrate, referringto the example of FIG. 4, the image module 130 may identify (e.g., basedon a change of position of the first leg 408 between the first image 412and the second image 414) that the leg movement(s) 402 indicate that theuser 102 is moving (e.g., walking) to the right (rather than left).Accordingly, in some embodiments, the media device 104 may generate anaudio signal to provide confirmation that the user is walking toward acorrect side of the street (e.g., when the user 102 is crossing or isabout to cross the street). To illustrate, the media device 104 maygenerate an audio signal, such as “Yes, the gas station is on the otherside of this street about 200 yards away.” By contrast, in someembodiments, if the leg movement(s) 402 indicates that the user 102 ismoving left (from the perspective of the user 102), the media device 104may generate an audio signal with updated navigation directions. Toillustrate, the media device 104 may generate an audio signal, such as“No, not on that side of the street, the gas station is located on theother side of the street.”

FIG. 4 illustrates a particular embodiment in which the wearable device406 includes a first sensor 416 (e.g., an accelerometer) and a secondsensor 418 (e.g., a compass). However, it will be appreciated that inalternative embodiments more than two sensors or less than two sensorsmay be used. In some cases, the wearable device 406 may communicatesensor data to the media device 104 via a wireless signal (e.g., a Wi-Fisignal or a near-field communication signal). The media device 104 maybe configured to determine the leg movement(s) 404 based onaccelerometer data received from the first sensor 416 of the wearabledevice 406 and/or compass data received from the second sensor 418 ofthe wearable device 406. In some cases, the media device 104 may provideinformation associated with the leg movement(s) 404 to the navigationmodule 132, the audio adjustment module 134, and/or the workout module136. With respect to navigation, the navigation module 132 may provideupdated navigation directions and/or a confirmation of a particulardirection based on the leg movement(s) 404 in a manner similar to thatdescribed above with respect to the leg movement(s) 402.

As another example, the user 102 may initiate an application (e.g., anaudio application or a gaming application) via a user interface of themedia device 104. In response, the media device 104 may initiate anapplication that may compare the leg movement(s) 404 to previouslyidentified types of leg movements, such as walking, jogging, running, orkicking, among other alternatives. As a first illustrative example, themedia device 104 may store information that may correspond to a walkinggait, a jogging gait, a running gait, and one or more types of kickmovements. To illustrate, in the context of an audio application, theaudio adjustment module 134 may increase a volume of the audio signal142 in response to an upward leg movement and may decrease the volume inresponse to a downward leg movement. As other examples, a directionand/or a speed of a detected leg movement may be used to skip forwardthrough audio tracks, to skip backward through audio tracks, to fastforward through audio tracks, to fast forward backward through audiotracks, among other alternatives. To illustrate, a one-timeshort-distance quick leg movement to the right may correspond toskipping forward through audio tracks, while a one-time short-distancequick leg movement to the left may correspond to skipping backwardthrough audio tracks. As another example, a two-time long-distance quickleg movement to the right may correspond to fast forwarding throughaudio tracks, while a two-time long-distance quick leg movement to theleft may correspond to fast forwarding backward through audio tracks. Asa further example, a one-time long-distance leg movement to the right orto the left may correspond to stopping or pausing a search through audiotracks. An up or down leg movement may correspond to playing oraccepting an option (e.g., a song), while a left or right leg movementmay correspond to cancelling an option. Further, the media device 104may store information associated with music tracks that were playeddepending on a pace of leg movements (e.g., songs played when running,songs played when jogging, or songs played when walking, among otheralternatives). In this case, the workout module 136 (see FIG. 1) mayreplay particular music tracks when the leg movement(s) 404 correspondto a particular pace of movement.

As another illustrative example, in the context of a gaming application,the leg movement(s) 402 may be provided as input data to a gamingapplication. As an illustrative, non-limiting example, a particular legmovement may correspond to a particular action in a game. For example,when the leg movement(s) 402 includes upward leg movement(s), a firstaction (e.g., a kick in a combat game) may be executed. As anotherexample, when the leg movement(s) 402 includes left or rightmovement(s), other actions (e.g., a leg sweep to the left or to theright in a combat game) may be executed. As a further example, when theleg movement(s) 402 include downward leg movement(s), another action(e.g., moving a player avatar backward within a game) may be executed.As another example, when the gaming application includes music (e.g., aguitar playing game or a dancing game), the leg movement(s) 402 may beused to determine whether body movement(s) are synchronized with themusic. To illustrate, a user's score in the game may increase inresponse to detecting movement such as a quick twist when a music volumeincreases or the music is relatively fast-paced (e.g., rock music). Asanother example, the user's score may increase in response to detectingmovement such as slow motion when the music is relatively slow-paced.

In some cases, the wearable device 406 may be used to provide command(s)to the media device 104 when it may be inconvenient for the user 102 toprovide input via the media device 104 itself (e.g., when the user iswalking, jogging, or running). Accordingly, the accelerometer dataand/or the compass data from the wearable device 406 may provide analternative option for providing command(s) to the media device 104. Asillustrative examples, a very quick leg movement (e.g., running) may beused to access a rock/rap/fast-paced song list, a quick leg movement(e.g., jogging) may be used to access a light rock song list, a slow legmovement (e.g., walking) may be used to access a light rock song list,and a very slow leg movement (e.g., walking slowly) may be used toaccess a classical/slow-paced song list.

Thus, FIG. 4 illustrates a particular example in which camera(s)associated with earpiece(s) of an audio headset device may be used todetermine leg movement(s). In some cases, the leg movement(s) may beused to provide updated navigation directions when the image datacaptured by the camera(s) indicates that a user is moving in a wrongdirection with respect to a particular location. In this case, the mediadevice may generate an audio signal that may indicate that the user ismoving in the wrong direction. Alternatively, the leg movement(s) may beused to confirm that the user is moving in a correct direction withrespect to a particular location. FIG. 4 further illustrates that, insome cases, a wearable device may include sensor(s) that may be used toprovide information to a media device that may be used to identify legmovement(s).

FIG. 5 illustrates a particular embodiment of a method 500 to determine,in the context of providing navigation directions, whether an accessorydevice satisfies accessory device orientation criteria based oninformation associated with a movement of the accessory device, wherethe accessory device is communicatively coupled to a media device (e.g.,via a wired interface). In the example of FIG. 5, the media device maygenerate a first signal (e.g., a first audio signal) in response todetermining that the accessory device orientation criteria are notsatisfied and may generate a second signal (e.g., a second audio signal)in response to determining that the accessory device orientationcriteria are satisfied. To illustrate, the first audio signal mayinclude accessory device re-orientation information (e.g., for receivingnavigation directions to a particular location), while the second audiosignal may include a confirmation of correct positioning (e.g., forreceiving the navigation directions).

The method 500 includes receiving information associated with movementof an accessory device at a media device, at 502. The accessory deviceis communicatively coupled to the media device (such as via a wired orwireless interface of the media device). For example, referring to FIG.1, the media device 104 may receive the sensor data 138 from the firstearpiece 110 of an audio headset device and may receive the sensor data140 from the second earpiece 112 of the audio headset device. The firstearpiece 110 and the second earpiece 112 may be communicatively coupledto the media device 104 via the wires 108 and the audio interface 106.For example, the audio interface 106 of the audio headset device may becoupled to the media device 104 via a mini-phone jack of the mediadevice 104.

The method 500 further includes determining, at the media device,whether the accessory device satisfies accessory device orientationcriteria based on the information, at 504. As an illustrative example,referring to FIG. 1, the accessory device may correspond to the firstsensor 116 (e.g., a camera) of the first earpiece 110 or the firstsensor 124 of the second earpiece 112. Thus, the sensor data 138received from the first earpiece 110 may include first image data andthe sensor data 140 from the second earpiece 112 may include secondimage data. In the example illustrated in FIG. 1, from the perspectiveof the user 102, the first earpiece 110 is positioned in the user'sright ear, while the second earpiece 112 is positioned in the user'sleft ear. That is, the first image data captured by the camera 116 inthe first earpiece 110 may correspond to a view in a right-handdirection from the perspective of the user 102, while the second imagedata captured by the camera 124 may correspond to a view in a left-handdirection from the perspective of the user 102.

As one example, the image module 130 of the media device 104 maydetermine whether the first earpiece 110 satisfies accessory deviceorientation criteria based on the sensor data 138 (e.g., first imagedata) received from the first earpiece 110. As another example, theimage module 130 may determine whether the second earpiece 112 satisfiesaccessory device orientation criteria based on the sensor data 140(e.g., second image data) received from the second earpiece 112. In aparticular embodiment, the image module 130 may generate a compositeimage (e.g., a 3D image) based on the first image data and the secondimage data. In this case, from the perspective of the user 102, thecomposite image may correspond to a panoramic view that includes imagedata captured by one camera positioned in a right-hand direction andanother camera positioned in a left-hand direction. Thus, in the exampleof FIG. 1, the image module 130 of the media device 104 may determine,from the perspective of the user 102, a position of a user's head forreceiving navigation directions.

In response to determining that the accessory device orientationcriteria is not satisfied, the method 500 may include generating a firstsignal (e.g., a first audio signal) to be communicated from the mediadevice to the accessory device via the wired or a wireless interface, at506. The first audio signal may include accessory device re-orientationcriteria (e.g., for receiving navigation directions). In alternativeembodiments, information may be visually communicated to the user (e.g.,via a display of the media device). In the particular embodimentillustrated in FIG. 5, the method 500 includes generating a secondsignal (e.g., a second audio signal) to be communicated from the mediadevice to the accessory device via the wired or a wireless interface inresponse to determining that the accessory device orientation criteriais satisfied, at 508. To illustrate, the second audio signal may includea confirmation of correct positioning of the accessory device (e.g., forreceiving navigation directions). In alternative embodiments,information may be visually communicated to the user (e.g., via adisplay of the media device).

As a first illustrative example, referring to FIG. 1, the image module130 may provide information to the navigation module 132 with respect toa position of the user's head for receiving navigation directions. Basedon the information, the navigation module 132 may generate the audiosignal 142. In the event that the information indicates that the user'shead is not correctly positioned for receiving navigation directions toa particular location, the audio signal 142 may include updatednavigation directions. In some cases, in the event that the informationindicates that the user's head is correctly positioned for receiving thenavigation directions to the particular location, the audio signal 142may include a confirmation that the user's head is correctly positioned.Alternatively, the navigation module 132 may refrain from providing anaudio signal in the event that the user's head is correctly positionedfor receiving the navigation directions to the particular location.

Thus, FIG. 5 illustrates that one or more sensors included in anaccessory device (e.g., an audio headset device) may provide movementinformation to a media device. The media device may determine whetherthe accessory device satisfies accessory device orientation criteria andmay generate an audio signal based on whether the accessory deviceorientation criteria are satisfied. To illustrate, when the orientationcriteria are not satisfied, the audio signal may include accessorydevice re-orientation information (e.g., for receiving navigationdirections to a particular location).

FIG. 6 illustrates a particular embodiment of a method 600 to identify amovement (e.g., a head movement, a hand movement, or a leg movement)based on image data captured by a camera disposed within an earpiece ofan audio headset device and sending an audio signal to the audio headsetdevice based on the identified movement.

The method 600 includes receiving first image data captured by a cameradisposed within an earpiece of an audio headset device, at 602. As afirst illustrative example, FIG. 2 illustrates a particular embodimentin which the movement includes one or more head movements 202. In FIG.2, the first image data 206 captured by the camera disposed within thefirst earpiece 110 may correspond to the first image 204. Alternatively,the first image data 214 captured by the camera disposed within thesecond earpiece 112 may correspond to the first image 212. As a secondillustrative example, FIG. 3 illustrates a particular embodiment inwhich the movement includes one or more hand movements 302. In FIG. 3,image data captured by the camera disposed within the second earpiece112 may correspond to the first image 312. As a third illustrativeexample, FIG. 4 illustrates a particular embodiment in which themovement includes one or more leg movements 402. In FIG. 4, image datacaptured by the camera disposed within the second earpiece 112 maycorrespond to the first image 412.

The method 600 includes receiving second image data captured by thecamera disposed within the earpiece of the audio headset device, at 604.As a first illustrative example, FIG. 2 illustrates a particularembodiment in which the movement includes one or more head movements202. In FIG. 2, the second image data 210 captured by the cameradisposed within the first earpiece 110 may correspond to the secondimage 208. Alternatively, the second image data 218 captured by thecamera disposed within the second earpiece 112 may correspond to thesecond image 216. As a second illustrative example, FIG. 3 illustrates aparticular embodiment in which the movement includes one or more handmovements 306. In FIG. 3, image data captured by the camera disposedwithin the second earpiece 112 may correspond to the second image 314.As a third illustrative example, FIG. 4 illustrates a particularembodiment in which the movement includes one or more leg movements 402.In FIG. 4, image data captured by the camera disposed within the secondearpiece 112 may correspond to the second image 414.

The method 600 further includes identifying a movement (e.g., a headmovement, a hand movement, or a leg movement) based on the first imagedata and the second image data, at 606.

As a first illustrative example, FIG. 2 illustrates a particularembodiment in which the movement includes one or more head movements202. In FIG. 2, the one or more head movements 202 may be identifiedbased on the first image data 206 and the second image data 210 capturedby the camera disposed within the first earpiece 110. In this case, thehead movement(s) 202 may be identified by comparing a position of one ormore objects (e.g., the first reference object 222, the second referenceobject 224, and/or the third object 226) in the first image 204 and/orthe second image 208. Alternatively, the one or more head movements 202may be identified based on the first image data 214 and the second imagedata 218 captured by the camera disposed within the second earpiece 112.In this case, the head movement(s) 202 may be identified by comparing aposition of one or more objects (e.g., the first reference object 228,the second reference object 230, and/or the third object 232) in thefirst image 212 and/or the second image 216.

As a second illustrative example, FIG. 3 illustrates a particularembodiment in which the movement includes one or more hand movements302. In FIG. 3, image data captured by the camera disposed within thesecond earpiece 112 may correspond to the first image 312. In FIG. 3,the one or more hand movements 302 may be identified based on the firstimage data 312 and the second image data 314 captured by the cameradisposed within the second earpiece 112. As a third illustrativeexample, FIG. 4 illustrates a particular embodiment in which themovement includes one or more leg movements 402. In FIG. 4, image datacaptured by the camera disposed within the second earpiece 112 maycorrespond to the first image 412. In FIG. 4, the one or more legmovements 402 may be identified based on the first image data 412 andthe second image data 414 captured by the camera disposed within thesecond earpiece 112.

The method 600 also includes sending an audio signal to the audioheadset device, at 608. The audio signal is determined based on theidentified movement. For example, referring to FIG. 2, the media device104 may send the audio signal 220 to the first earpiece 110, to thesecond earpiece 112, or a combination thereof. Similarly, referring toFIGS. 3 and 4, the media device 104 may send an audio signal to thefirst earpiece 110, to the second earpiece 112, or a combination thereof

Thus, FIG. 6 illustrates a method to identify a movement (e.g., a headmovement, a hand movement, or a leg movement) based on image datacaptured by a camera disposed within an earpiece of an audio headsetdevice and sending an audio signal to the audio headset device based onthe identified movement.

FIG. 7 illustrates a particular embodiment of a method 700 to identify amovement (e.g., a head movement in the context of providing navigationdirections) based on image data captured by cameras disposed withinearpieces of an audio headset device and sending an audio signal to theaudio headset device based on the identified movement. In FIG. 7, theaudio signal may include updated navigation directions to a particularlocation when directional orientation criteria (e.g., head orientationcriteria) are not satisfied. FIG. 7 illustrates that the audio signalmay include a confirmation of correct positioning (e.g., headorientation, hand orientation, or leg orientation) for receivingnavigation directions to the particular location when the directionalorientation criteria are satisfied.

The method 700 includes receiving first image data captured by a firstcamera disposed within a first earpiece of an audio headset device, at702. For example, referring to FIG. 2, the media device 104 may receivethe first image data 206 captured by the camera 116 disposed within thefirst earpiece 110. The method 700 includes receiving second image datacaptured by the camera disposed within the first earpiece, at 704. Forexample, referring to FIG. 2, the media device 104 may receive thesecond image data 210 captured by the camera 116 disposed within thefirst earpiece 110.

The method 700 further includes receiving third image data captured by acamera disposed within a second earpiece of the audio headset device, at706. For example, referring to FIG. 2, the media device 104 may receivethe first image data 214 captured by the camera 124 disposed within thesecond earpiece 112. The method 700 includes receiving fourth image datacaptured by the camera disposed within the second earpiece, at 708. Forexample, referring to FIG. 2, the media device 104 may receive thesecond image data 218 captured by the camera 124 disposed within thesecond earpiece 112.

The method 700 also includes identifying a movement (e.g., a headmovement) based on the first and second image data received from thefirst camera, and the first and second image data received from thesecond camera, at 710. For example, referring to FIG. 2, the imagemodule 130 of the media device 104 may identify head movement(s) 202based on the first image data 206 and the second image data 210 receivedfrom the camera 116 disposed within the first earpiece 100 and based onthe first image data 214 and the second image data 216 received from thecamera 124 disposed within the second earpiece 112.

In response to determining that the directional orientation criteria arenot satisfied, the method 700 may include sending an audio signal to theaudio headset device, at 712. The audio signal may include updatednavigation directions to a particular location. For example, referringto FIG. 2, the image module 130 may provide information to thenavigation module 132, and the navigation module 132 may determinewhether the directional orientation criteria (e.g., a position of auser's head to receive navigation directions to a particular location)are satisfied.

In the particular embodiment illustrated in FIG. 7, the method 700 alsoincludes sending an audio signal to the audio headset device in responseto determining that the directional orientation criteria are satisfied,at 714. The audio signal may include a confirmation of correctpositioning (e.g., of a user's head) for receiving navigation directionsto the particular location. For example, referring to FIG. 2, in somecases, the media device 104 may send an audio signal to the firstearpiece 110, to the second earpiece 112, or a combination thereof.

Thus, FIG. 7 illustrates a particular embodiment of a method to identifya movement (e.g., a head movement) based on image data captured bycameras disposed within earpieces of an audio headset device and sendingan audio signal to the audio headset device based on the identifiedmovement.

Referring to FIG. 8, an illustrative embodiment of a general computersystem is shown and is designated 800. The computer system 800 includesa set of instructions that can be executed to cause the computer system800 to perform any one or more of the methods or computer basedfunctions disclosed herein. The computer system 800 may operate as astandalone device or may be connected, e.g., using a network, to othercomputer systems or peripheral devices. For example, the computer system800 may include or be included within the media device 104 describedwith reference to FIGS. 1-4.

In a networked deployment, the computer system 800 may operate in thecapacity of a server or as a client user computer in a server-clientuser network environment, or as a peer computer system in a peer-to-peer(or distributed) network environment. The computer system 800 may alsobe implemented as or incorporated into various devices, such as a mobiledevice, a palmtop computer, a laptop computer, a desktop computer, acommunications device, a wireless telephone, a personal computer (PC), atablet PC, a personal digital assistant (PDA), an endpoint device, a webappliance, or any other machine capable of executing a set ofinstructions (sequential or otherwise) that specify actions to be takenby that machine. In a particular embodiment, the computer system 800 maybe implemented using electronic devices that provide video, audio, ordata communication. Further, while a single computer system 800 isillustrated, the term “system” shall also be taken to include anycollection of systems or sub-systems that individually or jointlyexecute a set, or multiple sets, of instructions to perform one or morecomputer functions.

As illustrated in FIG. 8, the computer system 800 may include aprocessor 802, e.g., a central processing unit (CPU), a graphicsprocessing unit (GPU), or both. For example, the processor 802 mayinclude or correspond to a processor of the media device 104. Moreover,the computer system 800 may include a main memory 804 and a staticmemory 806, which can communicate with each other via a bus 808. Forexample, the main memory 804 may include or correspond to a memory ofthe media device 104. As shown, the computer system 800 may furtherinclude a video display unit 810, such as a liquid crystal display(LCD), a light emitting diode (LED) display, a touch screen display, aflat panel display, or a solid state display. Additionally, the computersystem 800 may include an input device 812, such as a remote controldevice or a keyboard, and a cursor control device 814, such as a mouse.In some embodiments, the input device 812 and the cursor control device814 may be integrated into a single device, such as a capacitive touchscreen input device. The computer system 800 may also include a driveunit 816, a signal generation device 818, such as a speaker, and anetwork interface device 820. Some computer systems 800 may not includean input device (e.g., a server may not include an input device).

In a particular embodiment, as depicted in FIG. 8, the drive unit 816may include computer-readable storage 822 in which one or more sets ofinstructions 824, e.g. software, can be embedded. The computer-readablestorage 822 may be random access memory (RAM), read-only memory (ROM),programmable read-only memory (PROM), erasable PROM (EPROM),electrically erasable PROM (EEPROM), register(s), solid-state memory,hard disk, a removable disk, a compact disc read-only memory (CD-ROM),other optical disk storage, magnetic disk storage, magnetic storagedevices, or any other storage device that can be used to store programcode in the form of instructions or data and that can be accessed by acomputer and/or a processor. Computer-readable storage is not a signal.Further, the instructions 824 may embody one or more of the methods orlogic as described herein. In the embodiment illustrated in FIG. 8, theinstructions 824 include the image module 130, the navigation module132, the audio adjustment module 134, and the workout module 136. Theinstructions 824, including the image module 130, the navigation module132, the audio adjustment module 134, and the workout module 136, may beexecutable by the processor 802 to perform one or more functions ormethods described herein, such as the methods 500, 600, and 700described with reference to FIG. 5, FIG. 6, and FIG. 7, respectively. Ina particular embodiment, the instructions 824 may reside completely, orat least partially, within the main memory 804, the static memory 806,and/or within the processor 802 during execution by the computer system800. The main memory 804 and the processor 802 also may include acomputer-readable storage device.

In an alternative embodiment, dedicated hardware implementations, suchas application specific integrated circuits, programmable logic arraysand other hardware devices, may be constructed to implement one or moreof the methods described herein. Various embodiments may include avariety of electronic and computer systems. One or more embodimentsdescribed herein may implement functions using two or more specificinterconnected hardware modules or devices with related control and datasignals that can be communicated between and through the modules, or asportions of an application-specific integrated circuit (ASIC).Accordingly, the present system encompasses software, firmware, andhardware implementations.

In accordance with various embodiments of the present disclosure, themethods described herein may be implemented by software programsexecutable by a computer system, a processor, or a device, which mayinclude forms of instructions embodied as a state machine implementedwith logic components in an ASIC or a field programmable gate array(FPGA) device. Further, in an exemplary, non-limiting embodiment,implementations may include distributed processing, component/objectdistributed processing, and parallel processing. Alternatively, virtualcomputer system processing may be constructed to implement one or moreof the methods or functionality as described herein. It is further notedthat a computing device, such as a processor, a controller, a statemachine or other suitable device for executing instructions to performoperations may perform such operations directly or indirectly by way ofone or more intermediate devices directed by the computing device.

The present disclosure includes computer-readable storage 822 thatstores instructions 824, so that a device connected to a network 828 maycommunicate voice, video or data over the network 828. While thecomputer-readable storage 822 is shown to be a single device, thecomputer-readable storage 822 may include a single device or multipledevices, such as a centralized or distributed database, and/orassociated caches and servers that store one or more sets ofinstructions. The computer-readable storage 822 is capable of storing aset of instructions for execution by a processor to cause a computersystem to perform any one or more of the methods or operations disclosedherein. For example, the computer-readable storage 822 may storeinstructions for execution by a processor to cause a computer system toperform any one or more of the methods 500, 600, and 700 described withreference to FIG. 5, FIG. 6, and FIG. 7, respectively.

In a particular non-limiting, exemplary embodiment, thecomputer-readable storage 822 may include a solid-state memory such asembedded memory (or a memory card or other package that houses one ormore non-volatile read-only memories). Further, the computer-readablestorage 822 may be a random access memory or other volatile re-writablememory. Additionally, the computer-readable storage 822 may include amagneto-optical or optical device, such as a disk or tapes or otherstorage device. Accordingly, the disclosure is considered to include anyone or more of computer-readable storage and other equivalents andsuccessor devices, in which data or instructions may be stored.

Although the one or more components and functions may be describedherein as being implemented with reference to particular standards orprotocols, the disclosure is not limited to such standards andprotocols. Such standards are from time-to-time superseded by faster ormore efficient equivalents having essentially the same functions.Wireless standards for device detection, short-range communications, andlong-range communications can be used by the computer system 800 inselected embodiments.

The illustrations of the embodiments described herein are intended toprovide a general understanding of the structure of the variousembodiments. The illustrations are not intended to serve as a completedescription of all of the elements and features of apparatus and systemsthat utilize the structures or methods described herein. Many otherembodiments may be apparent to those of skill in the art upon reviewingthe disclosure. Other embodiments may be utilized and derived from thedisclosure, such that structural and logical substitutions and changesmay be made without departing from the scope of the disclosure. Figuresare also merely representational and may not be drawn to scale.Accordingly, the disclosure and the figures are to be regarded asillustrative rather than restrictive.

Although specific embodiments have been illustrated and describedherein, it should be appreciated that any subsequent arrangementdesigned to achieve the same or similar purpose may be substituted forthe specific embodiments shown. This disclosure is intended to cover anyand all subsequent adaptations or variations of various embodiments.

Less than all of the steps or functions described with respect to theexemplary processes or methods can also be performed in one or more ofthe exemplary embodiments. Further, the use of numerical terms todescribe a device, component, step or function, such as first, second,third, and so forth, is not intended to describe an order unlessexpressly stated. The use of the terms first, second, third and soforth, is generally to distinguish between devices, components, steps orfunctions unless expressly stated otherwise. Additionally, one or moredevices or components described with respect to the exemplaryembodiments can facilitate one or more functions, where the facilitatingcan include less than every step needed to perform the function or caninclude all of the steps needed to perform the function.

In one or more embodiments, a processor (which can include a controlleror circuit) has been described that performs various functions. Itshould be understood that the processor can be implemented as multipleprocessors, which can include distributed processors or parallelprocessors in a single machine or multiple machines. The processor canbe used in supporting a virtual processing environment. The virtualprocessing environment may support one or more virtual machinesrepresenting computers, servers, or other computing devices. In suchvirtual machines (e.g., virtual servers), components such asmicroprocessors and storage devices may be virtualized or logicallyrepresented. The processor can include a state machine, an applicationspecific integrated circuit, and/or a programmable gate array (PGA)including a FPGA. In one or more embodiments, when a processor executesinstructions to perform “operations”, this can include the processorperforming the operations directly and/or facilitating, directing, orcooperating with another device or component to perform the operations.

The Abstract is provided with the understanding that it will not be usedto interpret or limit the scope or meaning of the claims. In addition,in the foregoing Detailed Description, various features may be groupedtogether or described in a single embodiment for the purpose ofstreamlining the disclosure. This disclosure is not to be interpreted asreflecting an intention that the claimed embodiments require morefeatures than are expressly recited in each claim. Rather, as thefollowing claims reflect, inventive subject matter may be directed toless than all of the features of any of the disclosed embodiments. Thus,the following claims are incorporated into the Detailed Description,with each claim standing on its own as defining separately claimedsubject matter.

The above-disclosed subject matter is to be considered illustrative, andnot restrictive, and the appended claims are intended to cover all suchmodifications, enhancements, and other embodiments, which fall withinthe scope of the present disclosure. Thus, to the maximum extent allowedby law, the scope of the present disclosure is to be determined by thebroadest permissible interpretation of the following claims and theirequivalents, and shall not be restricted or limited by the foregoingdetailed description.

What is claimed is:
 1. A method comprising: receiving, at a media devicefrom an accessory device, first image data captured by a first cameradisposed within a first earpiece of the accessory device; receivingsecond image data captured by the first camera; receiving third imagedata captured by a second camera disposed within a second earpiece ofthe accessory device; receiving fourth image data captured by the secondcamera; generating a first composite image based on the first image dataand the third image data; generating a second composite image based onthe second image data and the fourth image data; identifying, at aprocessor of the media device, a particular movement of a user of theaccessory device based on the first composite image and the secondcomposite image; based on the particular movement indicating that theuser has a first orientation, generating a first signal indicating thatthe user is oriented away from a particular location; and in response todetermining, after the generating the first signal and based on thesecond image data, that the user has a second orientation, generating asecond signal indicating that the user is oriented toward the particularlocation, wherein one or both of the first signal and the second signalfurther indicate navigation directions to the particular location. 2.The method of claim 1, further comprising: receiving at the media devicea location request indicating the particular location; and sending anaudio message to the accessory device that informs the user whether aparticular limb of the user associated with the particular movement ispointing toward the particular location.
 3. The method of claim 1,further comprising receiving, at the media device, a specific phrasefrom the user of the accessory device before the identifying theparticular movement.
 4. The method of claim 1, further comprisingidentifying, at the processor, another movement of the user beforeidentifying the particular movement.
 5. The method of claim 1, furthercomprising determining, at the processor, that the particular movementdoes not correspond to a rhythmic movement associated with the userbefore generating the first signal.
 6. The method of claim 1, wherein alimb associated with the particular movement includes a leg.
 7. Themethod of claim 1, wherein a limb associated with the particularmovement includes an arm.
 8. The method of claim 1, further comprisingadjusting, based on the particular movement, a volume of audio output ofthe accessory device.
 9. A computer-readable hardware storage devicestoring instructions executable by a processor to perform operations,the operations comprising: receiving, from an accessory device, firstimage data captured by a first camera disposed within a first earpieceof the accessory device; receiving second image data captured by thefirst camera; receiving third image data captured by a second cameradisposed within a second earpiece of the accessory device; receivingfourth image data captured by the second camera; generating a firstcomposite image based on the first image data and the third image data;generating a second composite image based on the second image data andthe fourth image data; identifying a particular movement of a user ofthe accessory device based on the first composite image and the secondcomposite image; based on the particular movement indicating that theuser has a first orientation, generating a first signal indicating thatthe user is oriented away from a particular location; and in response todetermining, after the generating the first signal and based on thesecond image data, that the user has a second orientation, generating asecond signal indicating that the user is oriented toward the particularlocation, wherein one or both of the first signal and the second signalfurther indicate navigation directions to the particular location. 10.The computer-readable hardware storage device of claim 9, wherein theidentifying of the particular movement comprises comparing a firstposition of a leg in the first image data to a second position of theleg in the second image data.
 11. The computer-readable hardware storagedevice of claim 9, wherein the operations further comprise identifying ahead movement, a hand movement, or a leg movement based on the firstcomposite image and the second composite image.
 12. An apparatuscomprising: a memory; and a processor coupled to the memory andconfigured to: receive, from an accessory device, first image datacaptured by a first camera disposed within a first earpiece of theaccessory device; receive second image data captured by the firstcamera; receive third image data captured by a second camera disposedwithin a second earpiece of the accessory device; receive fourth imagedata captured by the second camera; generate a first composite imagebased on the first image data and the third image data; generate asecond composite image based on the second image data and the fourthimage data; identify a particular movement of a user of the accessorydevice based on the first composite image and the second compositeimage; based on the particular movement indicating a first orientationof the user, generate a first signal indicating that the user isoriented away from a particular location; and in response todetermining, after the generating the first signal and based on thesecond image data, that the user has a second orientation, generate asecond signal indicating that the user is oriented toward the particularlocation, wherein one or both of the first signal and the second signalfurther indicate navigation directions to the particular location. 13.The apparatus of claim 12, wherein the processor is further configuredto receive data from an accelerometer in the accessory device.
 14. Theapparatus of claim 12, wherein the processor is further configured toreceive data from a compass in the accessory device.
 15. The apparatusof claim 12, wherein the processor is further configured to receive aspecific phrase from the user of the accessory device before theidentifying the particular movement.
 16. The apparatus of claim 12,wherein the processor is further configured to detect one or moreobstacles indicated by the first composite image and to generate analert further based on detecting the one or more obstacles.
 17. Theapparatus of claim 12, wherein the first image data and the second imagedata represent a left side of the user, and wherein the third image dataand the fourth image data represent a right side of the user.
 18. Theapparatus of claim 12, wherein the processor is further configured todetermine a change in orientation of the user from the first orientationto the second orientation based on the first composite image and thesecond composite image.